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(57) A system and method for enabling information 
providers using a computer network (20) such as the 
Internet to influence a position for a search listing within 
a search result list generated by an Internet search en- 
gine (24). A database (38) stores accounts for the net- 
work information providers. Each account contains con- 
tact and billing information for a network information pro- 
vider. In addition, each account contains at least one 
search listing (344) having at least three components: 
a description (354), a search term (352) comprising one 
or more keywords, and a bid amount (358). The network 
information provider may add, delete, or modify a search 



listing after authenticated login. A search term relevant 
to the content of the web site or other information source 
to be listed is first selected. A search listing includes the 
search term and a description. A bidding process occurs 
when the network information provider enters a new bid 
amount for a search listing. The system and method 
then compares the bid amount with all other bid amounts 
for the same search term, and generates a rank value 
for all search listings having that search term. The rank 
value determines where the listing will appear on the 
search results list page that is generated in response to 
a query of the search term by a searcher. 
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Description 

BACKGROUND 

[0001] The transfer of information over computer net- 
works has become an increasingly important means by 
which institutions, corporations, and individuals do busi- 
ness. Computer networks have grown over the years 
from independent and isolated entities established to 
serve the needs of a single group into vast internets 
which interconnect disparate physical networks and al- 
iowthem to function as a coordinated system. Currently, 
the largest computer network in existence is the Inter- 
net. The Internet is a worldwide interconnection of com- 
puter networks that communicate using a common pro- 
tocol. Millions of computers, from low end personal com- 
puters to high end super computers, are connected to 
the Internet. 

[0002] The Internet has emerged as a large commu- 
nity of electronically connected users located aroun d the 
world who readily and regularly exchange significant 
amounts of information. The Internet continues to serve 
its original purposes of providing for access to and ex- 
change of information among government agencies, 
laboratories, and universities for research and educa- 
tion. In addition, the Internet has evolved to serve a va- 
riety of interests and forums that extend beyond its orig- 
inal goals. In particular, the Internet is rapidly transform- 
ing into a global electronic marketplace of goods and 
services as well as of ideas and information. 
[0003] This transformation of the Internet into a g lobal 
marketplace was driven in targe part by the introduction 
of an information system known as the World Wide Web 
("the web*). The web is a unique distributed database 
designed to give wide access to a large universe of doc- 
uments. The database records of the web are in the form 
of documents known as "pages". These pages reside 
on web servers and are accessible via the Internet The 
web is therefore a vast database of information dis- 
persed across countless individual computer systems 
that is constantly changing and has no recognizable or- 
ganization or morphology. Computers connected to the 
Internet may access the web pages via a program 
known as a browser, which has a powerful, simple-to- 
leam graphical user interface. One powerful technique 
supported by the web browser is known as hyperlinking, 
which permits web page authors to create links to other 
web pages which users can then retrieve by using sim- 
ple point-and-click commands on the web browser. 
[0004] The pages may be constructed in any one of 
a variety of formatting conventions, such as Hyper Text 
Markup Language (HTML), and may include multimedia 
information content such as graphics, audio, and mov- 
ing pictures. Any person with a computer and a connec- 
tion to the Internet may access any publicly accessible 
page posted on {he web. Thus, a presence on the World 
Wide Web has the capability to introduce a worldwide 
base of consumers to businesses, individuals, and in- 



stitutions seeking to advertise their products and serv- 
ices to potential customers. Furthermore, the ever in- 
creasing sophistication in the design of web pages, 
made possible by the exponential increase in datatrans- 
5 mission rates and computer processing speeds, makes 
the web an increasingly attractive medium for advertis- 
ing and other business purposes, as well as for the free 
flow of information. 

[0005] The availability of powerful new tools that fa- 
te cilitate the development and distribution of Internet con- 
tent has led to a proliferation of information, products, 
and services offered on the Internet and dramatic 
growth in the number of consumers using the Internet. 
International Data Corporation, commonly referred to as 
*5 IDC, estimates that the number of Internet users will 
grow from approximately 97 million worldwide in 1998 
to approximately 320 million worldwide by the end of 
2002. in addition, commerce conducted over the Inter- 
net has grown and is expected to grow dramatically. IDC 
20 estimates that the percentage of Internet users buying 
goods and services on the Internet will increase from 
approximately 28% at the end of 1 998 to approximately 
40% in 2002, and that over the same period of time, the 
total value of goods and services purchased over the 
25 internet will increase from approximately $32.4 billion to 
approximately $425.7 billion. 

[0006] The Internet has emerged as an attractive new 
medium tor businesses and advertisers of information, 
products and sen/ices to reach these large numbers of 

30 consumers. However, the web is composed of a seem- 
ingly limitless number of web pages dispersed across 
millions of different computer systems all over the world 
in no discernible organization. Search services or mech- 
anisms, such as directories and search engines, have 

35 been developed to index and search the information 
available on the web and thereby help Internet users lo- 
cate information of interest. These search services en- 
able consumers to search the Internet for a listing of web 
sites based on a specific topic, product, or service of 

40 interest. 

[0007] Search services are, after e-mail, the most fre- 
quently used tool on the Internet. As a result, web sites 
providing search services offer advertisers significant 
reach into the Internet audience and give advertisers the 

45 opportunity to target consumer interests based on key- 
word or topical search requests. Businesses and adver- 
tisers have an interest in participating in search result 
listings. In doing so, they generally seek to maximize 
exposure and traffic to their web sites, while managing 

50 any costs associated with such exposure in an efficient 
and cost-effective manner 

[0008] Generally, in a web -based search on an Inter- 
net search engine, a user enters a search term compris- 
ing one or more keywords , which the search engine then 
55 uses to generate a listing of web pages that the user 
may access via a hyperlink. There are many ways in 
which a search engine can return the results listings. 
There are search engines that use automated search 
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technology which relies in large part on complex : math- 
emalics-based database search algorithms that select 
and rank web pages based on multiple criteria such as 
keyword density and keyword location. The search re- 
sults generated by such mechanisms often rely on blind 
mathematical formulas and may be random and even 
irrelevant. These search engines often catalog search 
results that rely on invisible web site descriptions, or 
"meta tags", that are authored by web site promoters. It 
is not uncommon for web site owners to tag their sites 
as they choose in attempt to attract additional consumer 
attention at little to no marginal cost. 
[0009J Other search engines and web site directories 
may also rely on manual efforts of limited editorial staffs 
to review web page information, which becomes an ev- 
er-increasing difficult task as the volume and diversity 
of Internet content grows. No matter what the process, 
however, web page owners seek to target more effec- 
tively their web exposure and distribute information to 
the attention of interested users on a current and com- 
prehensive basis, while maintaining costs or monitoring 
budgets. 

[0010] One known effort that has been used by adver- 
tisers to generate web site traffic is banner advertising, 
where web site promoters seeking to promote and in- 
crease their web exposure purchase space on the pag- 
es of popular commercial web sites. The web site pro- 
moters usually fill this space with a colorful graphic, 
known as a banner, advertising their own web site and 
acting as a hyperlink for a visitor to click on to access 
the site. Banners may be displayed at every page ac- 
cess or may be targeted to search terms used on a 
search engine. Like traditional advertising, banner ad- 
vertising on the Internet is typically priced only on an 
impression basis, with advertisers paying for exposures 
to potential consumers. Using only this type of advertis- 
ing, however, may not necessarily provide the most de- 
sirable or cost efficient exposure rate for a business or 
advertiser seeking to target interested consumers. 
[001 1] internet advertising can offer a level of target- 
ability, interactivity, and measurability not generally 
available in other media. With the proper tools, Internet 
advertisers have the ability to direct and target their 
messages to specific groups of consumers and receive 
prompt feedback as to the effectiveness of their adver- 
tising campaigns. Many of the traditional paradigms of 
advertising and search engine algorithms fail to offer ap- 
propriate options to businesses or advertisers orto max- 
imize the delivery of relevant information via the web to 
interested parties in a cost-effective manner for those 
businesses and advertisers. Ideally, web site promoters 
or advertisers should be able to control their placement 
in search result listings so that their listings appear in 
searches that are relevant to the content of their web 
site and to control their mode of participation and any 
associated costs so that such listings are desirable or 
effective for their business. Search engine functionality 
needs to facilitate an on-line marketplace which offers 



consumers quick ( easy and relevant search results 
while providing Internet advertisers and promoters with 
a cost-effective way to target consumers in a manner 
they determine most appropriate for their business 
5 goals. In this on-line marketplace, companies selling 
products, services, or information will be able to deter- 
mine the options that best suit its advertising and cost 
needs and appear in desirable positions on a search re- 
sult list generated by an Internet search engine. 
10 [0012] Since advertisers generally must pay for each 
referral generated through the search result lists gener- 
ated by the search engine, advertisers have an incentive 
to select and bid on those search keywords that are 
most relevant to their web site offerings. A referral can 
is be of any one of a number types. One type of referral is 
an impression referral, whereby the advertiser's listing 
appears in the search results list. Another type of referral 
is a click-through referral, whereby a consumer clicks 
on the advertiser's listing. Still another type of referral is 
20 an action referral, whereby after the consumer has 
clicked on the advertiser's listing, the consumer takes 
further action in connection with the advertiser's web 
site. These further actions include, for example, actions 
such as registering with the advertiser's site, participat- 
25 ing in a promotion in connection with the advertiser's 
site, and/or purchasing a good or service from the ad- 
vertiser. Advertisers can bid on one or more of the var- 
ious types of referrals. In the case where the advertiser 
bids on more than one type of referral, a bid will com- 
30 prise multiple elements, one element pertype of referral 
bid upon. The higherthe market value of an advertiser's 
bid, the higherthe advertiser's position on a search re- 
sult list. The higher an advertiser's position on a search 
result list, the higher the likelihood of a referral; that is, 
35 the higher the likelihood that a consumer will be referred 
to the advertiser's web site through the search result fist. 
[0013] It is therefore an object of the present invention 
to provide a system and method for enabling promoters 
to influence a position on a search result listing gener- 
*o ated by an Internet search engine for a specified set of 
search terms, 

[0014] It is also an object of the present invention to 
provide promoters with a search engine that permits 
such promoters to influence a higher placement in a 
search result list via a continuous, competitive online 
bidding process. 

[001 5] It is another object of the present invention to 
provide a cost-effective method of Internet advertising 
where the web site promoter is charged in direct propor- 
tion to the number of referrals generated by the search 
engine. 

[001 6] It is another object of the present invention to 
create a new method of advertising where advertisers 
can bid on those types of referrals that the advertiser 
55 wants to bid upon, and where the market value of that 
bid determines the advertiser's search results list place- 
ment A further object being that advertisers are allowed 
to select and modify referrals to better meet their busi- 
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ness needs. 
BRIEF SUMMARY 

[001 7] The present embodiments seek to address the 
aforementioned problems by providing a system and 
method for enabling a web site promoter using a com- 
puter network to influence a position within a search re- 
sult list generated by an Internet search engine. One 
embodiment relates to a system and method to enable 
a web site promoter to define a search listing for a 
search result list, select a search term relevant to the 
promoter's web site, and influence a search result list 
position for the search listing on an Internet search en- 
gine. When an Internet user enters the search terms in 
a search engine query, the search engine will generate 
a search result list with the web site promoter's listing in 
a position influenced by one or more parameters defined 
by the promoter. The present embodiments further per- 
mit web site promoters to select the types of referrals to 
utilize when selecting search terms for purposes of par- 
ticipating in the search result listings. 
[0018] The embodiments described herein use the 
concept of a bid, which corresponds to the economic 
value that an advertiser will give when network locations 
associated with the advertiser are referred to a searcher 
in response to a query from the searcher. The economic 
value may be a money amount charged or chargeable 
to the advertiser, either directly or indirectly. The eco- 
nomic value may be an amount debited from an account 
of the advertiser. The amount may be a money amount 
or another value, such as credit points. The economic 
value may be given by the advertiser to the operator of 
a database search system or to a third party. 
[0019] The economic value is given when a searcher 
is referred to one or more network locations, such as 
advertiser web sites, are referred to a searcher. The re- 
ferral may be made by presenting the network locations 
on a screen used for data entry and receipt by the 
searcher, alone or with other search results. This is re- 
ferred to as an impression. Alternatively, and in an em- 
bodiment generally described herein, the referral may 
occur when the searcher clicks on or clicks through to 
access the network locations of the advertiser, as will 
be described in greater detail below. Or the referral may 
be by some other action taken by the searcher after ac- 
cessing the network locations of the advertiser. 
[0020] in one embodiment, a web site promoter se- 
lects a search term and influences a position within the 
search result list generated by that search term by par- 
ticipating in an online competitive bidding process. This 
online competitive bidding process allows a web site 
promoter to pay for selected referrals and may be em- 
ployed in conjunction with an Internet search engine. Al- 
lowing promoters to pay for selected referrals applies 
market principles to advertising on the Internet. Conven- 
tional Internet search engines do not provide a way for 
web site promoters to easily predict the position of their 



web site in search results or guarantee their appearance 
in search results containing their web site description. 
A tool enabling advertisers to target web search terms 
relevant to their business and to influence the placement 

5 of their web site description within the search results 
provides a powerful advantage to businesses and oth- 
ers seeking to increase their web exposure. Further- 
more, a competitive pricing or bidding process and bas- 
ing pricing on type and number of web site referrals gen- 

10 erated helps ensure that the pricing structure reflects 
the market and is accessible to advertisers of all budget 
sizes. 

[0021] To participate In the process, an advertiser or 
web site promoter may access the advertiser's user ac- 
ts count through a secure web site. The advertiser may 
use the account to place bids on search terms that are 
relevant to the advertiser's web site. Each bid relates to 
a search term-web site combination and corresponds to 
money amounts that the advertiser will pay to the owner 

20 of the search engine each time a searcher is referred to 
the advertiser through the search result list generated 
by the search engine. These money amounts apply to 
one or more of the types of referrals, which include im- 
pression, click-through, or action. The appearance of 

25 the advertiser's listing in the search results list will result 
in an impression referral. A click-through referral will oc- 
cur when a searcher clicks on the advertiser's listing, 
and this click will result in an access request being sent 
to the advertiser's web site, which will respond by trans- 

30 mitting the advertiser's web page to the searcher's 
browser. An action referral will occur when, after the 
search is performed, the searcher performs a further ac- 
tion in connection with the advertiser's web page, includ- 
ing, for example, actions such as registering with the ad- 

35 vertiser's site, participating in a promotion in connection 
with the advertiser's site, or purchasing a good or serv- 
ice from the advertiser. In general, click-through refer- 
rals provide higher benefits to the advertiser than im- 
pression referrals, action referrals provide higher bene- 

^0 fits than click-through referrals, and some types of ac- 
tion referrals provide higher benefits than other types of 
actions. Nonetheless, all types of referrals provide ben- 
efits to the advertiser. Since the charge to the advertiser 
is based on the number and type of referrals to the ad- 

45 vertiser's web site that were generated by the search 
engine, the charge for placement is directly proportional 
to the benefits received. 

[0022] The higher the market value of the bid, the 
more advantageous the placement in the search result 

so list that is generated when the bidded search term is en- 
tered by a searcher using the search engine. The search 
result list is arranged in order of decreasing bid value, 
with the search listing corresponding to the highest val- 
ued bids displayed first to the searcher. Preferably, each 

55 search listing corresponding to a bid is identified on the 
display as a paid listing. Most preferably, the bid value 
is included on the identification, in addition, the search 
result list of the present embodiments is preferably com- 
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bined with "non-paid" web site descriptions generated 
by a conventional internet search engine, preferably in- 
cluding listings generated according to mathematics- 
based database search algorithms as discussed above. 
The combination of paid and unpaid listings helps en- 5 
sure that the searcher will receive the most complete 
and relevant search results. Most preferably, the non- 
paid listings are considered to have a bid value of zero 
and are therefore underneath the paid results. 
[0023J According to a first embodiment, there is pro- u> 
vided a system and method for enabling the web site 
promoters to influence a position for a search listing 
within a search result list generated by an Internet 
search engine. The advertiser or web site promoter first 
selects a search term comprising one or more keywords 15 
relevant to the content of the web site to be listed. The 
advertiser or web site promoter influences the rank po- 
sition for the search listing through an ongoing online 
competitive bidding process with other web site promot- 
ers. The bidding process occurs when an advertiser en- 20 
ters.a new set of bid element amounts for an existing 
search listing or enters a set of bid element amounts for 
a new search listing. Preferably, the advertiser or pro- 
moter's bid is then processed in real time. The value of 
this set of bid element amounts is compared with the 2s 
values of all other bids from other promoters for the 
same search term, and generates new rank values for 
all search listings having that search term. The rank val- 
ue determines the position where the promoter's web 
site description will appear on the search results list 30 
page that is generated when the search term is entered 
into the query box on the search engine by a searcher. 
A more valuable bid will result in a higher rank value and 
a more advantageous placement, which is preferably 
near the beginning of the search results list page. Pref- 35 
erably, the quantities used in the competitive bidding 
process are money amounts that the web site promoter 
will pay to an owner of the Internet search engine each 
time the advertiser's web site is referred by the search 
engine in the ways that the advertiser has bid upon. 40 
Most preferably, these money amounts will be deducted 
from an account balance that is retained in the promot- 
er's account for each time the promoter's web site is re- 
ferred by the search engine. 

[0024] One embodiment of the system and method 45 
provides a database having accounts for the web site 
promoters. Each account includes contact and billing in- 
formation for a web site promoter. In addition, each ac- 
count includes at least one search listing, each search 
listing having five components: a description of the web so 
site to be listed, the Uniform Resource Locator (URL) of 
the web site, a search term comprising one or more key- 
words, a set of bid element amounts, and a title for the 
search listing. Each account may also include the pro- 
moter's payment history and a history of search listings 55 
entered by the user. The promoter logs in to his or her 
account via an authentication process running on a se- 
cure server. Once logged in, the promoter may add, de- 



lete, or modify a search listing and modify its bid element 
amounts. The functions of adding or deleting a search 
listing, or modifying the bid element amounts of a search 
listing is to initiate the competitive bidding process de- 
scribed above. All search listing changes and modifica- 
tions are processed substantially in real time to support 
the online competitive bidding process. 
[0025] One embodiment provides a method of deter- 
mining the market value of a bid. A bid is comprised of 
a set of bid element amounts. Each element of the bid 
is associated with one type of referral. The market value 
of a bid is calculated as the sum of the market values of 
the elements of that bid. The market value of a bid ele- 
ment is calculated as the product of the amount of the 
bid element and the probability of the occurrence of the 
referral associated with that element. 
[0026] In an alternative embodiment of the system 
and method of the present invention, the system, in- 
stead of the web site promoter, selects the search term 
or terms relevant to the promoter's web site. This saves 
the promoter from doing this work, although it leaves the 
promoter with less control. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0027] 

FIG. 1 is a block diagram illustrating the relationship 
between a large network and one embodiment of 
the system and method for generating a pay-for- 
performance search result of the present invention; 
FIG. 2 is a chart of menus, display screens, and in- 
put screens used in one embodiment of the present 
invention; 

FIG. 3 is a flow chart illustrating the advertiser user 
login process performed in one embodiment of the 
present invention; 

FIG. 4 is a flow chart illustrating the administrative 
user login process performed in one embodiment 
of the present invention; 

FIG. 5 is a diagram of data for an account record 
for use with one embodiment of the present inven- 
tion; 

FIG. 6 is a flow chart Illustrating a method of adding 
money to an account record used in one embodi- 
ment of the present invention; 
FIG. 7 illustrates an example of a search result list 
generated by one embodiment of the present inven- 
tion; 

FIG. 8 is a flow chart illustrating a change bids proc- 
ess used in one embodiment of the present inven- 
tion; and 

FIG. 9 illustrates an example of a screen display 
used in the change bids process of FIG. 8. 
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DETAILED DESCRIPTION OF THE PRESENTLY 
PREFERRED EMBODIMENTS 

[0028] Methods and systems for generating a pay-for- 
placement search result determined by a site promoter, 
such as an advertiser, over a client/server based com- 
puter network system are disclosed. The following de- 
scription is presented to enable any person skilled in the 
art to make and use the invention. For purposes of ex- 
planation, specific nomenclature is set forth to provide 
a thorough understanding of the present invention. De- 
scriptions of specific applications are provided only as 
examples. Various modifications to the preferred em- 
bodiments will be readily apparent to those skilled in the 
art, and the general principles defined herein may be 
applied to other embodiments and applications without 
departing from the spirit and scope of the invention. 
Thus, the present invention is not intended to be limited 
to the embodiments shown, but is to be accorded the 
widest scope consistent with the principles and features 
disclosed herein. 

[0029] Referring now to the drawings, FIG. 1 is an ex- 
ample of a distributed system 10 configured as client/ 
server architecture used in a first embodiment. A "client" 
is a member of a class or group that uses the services 
of another class or group to which it is not related. In the 
context of a computer network, such as the Internet, a 
client is a process (i.e. roughly a program or task) that 
requests a service which is provided by another proc- 
ess, known as a server program. The client process us- 
es the requested service without having to know any 
working details about the other server program or the 
server itself. In networked systems, a client process 
usually runs on a computer that accesses shared net- 
work resources provided by another computer running 
a corresponding server process. However, it should also 
be noted that it is possible for the client process and the 
server process to run on the same computer. 
[0030] A "server" is typically a remote computer sys- 
tem that is accessible over a communications medium 
such as the internet. The client process may be active 
in a second computer system, and communicate with 
the server process over a communications medium that 
allows multiple clients to take advantage of the informa- 
tion-gathering capabilities of the server. Thus, the server 
essentially acts as an information provider for a compu- 
ter network. 

[0031] The block diagram of FIG. 1 therefore shows 
a distributed system 10 comprising a plurality of client 
computers 12, a plurality of advertiser web servers 14, 
an account management server 22, and a search en- 
gine web server 24, all of which are connected to a net- 
work 20. The network 20 will be hereinafter generally 
referred to as the Internet. Although the disclosed sys- 
tem and method are specifically useful for the Internet, 
it should be understood that the client computers 12, ad- 
vertiser web servers 14, account management server 
22, and search engine web server 24 may be connected 



together through one of a number of different types of 
networks. Such networks may include local area net- 
works (LANs), other wide area networks (WANs), and 
regional networks accessed over telephone lines, such 

5 as commercial information services. The client and 
server processes may even comprise different pro- 
grams executing simultaneously on a single computer. 
[0032] The client computers 12 can be conventional 
personal computers (PCs), workstations, or computer 

10 systems of any other size. Each client 12 typically in- 
cludes one or more processors, memories, input/output 
devices, and a network interface, such as a convention- 
al modem. The advertiser web servers 1 4, account man- 
agement server 22, and the search engine web server 
24can be similarly configured. However, advertiser web 
servers 1 4, account management server 22, and search 
engine web server 24 may each include many comput- 
ers connected by a separate private network. In fact the 
network 20 may include hundreds of thousands of indi- 

20 vidua! networks of computers. 

[0033] The client computers 12 can execute web 
browser programs 16, such as the NAVIGATOR, EX- 
PLORER, or MOSAIC browser programs, to locate the 
web pages or records 30 stored on advertiser server 1 4. 

25 The browser programs 1 6 allow the users to enter ad- 
dresses of specific web pages 30 to be retrieved. These 
addresses are referred to as Uniform Resource Loca- 
tors, or URLs, in addition, once a page has been re- 
trieved t the browser programs 1 6 can provide access to 

30 other pages or records when the user "clicks" on hyper- 
links to other web pages. Such hyperlinks are located 
within the web pages 30 and provide an automated way 
for the user to enter the URL of another page and to 
retrieve that page. The pages can be data records in- 

35 eluding as content plain textual information, or more 
complex digitally encoded multimedia content, such as 
software programs, graphics, audio signals, videos, and 
so forth. 

[0034] In one embodiment, Illustrated in FIG. 1 , client 

40 computers 1 2 communicate through the network 20 with 
various network information providers, including ac- 
count management server 22, search engine server 24, 
and advertiser servers 14 using the functionality provid- 
ed by a HyperText Transfer Protocol (HTTP), although 

45 other communications protocols, such as FTP, SNMP, 
TELNET, and a number of other protocols known in the 
art, may be used. Preferably, search engine server 24, 
account management server 22, and advertiser servers 
14 are located on the World Wide Web. 

so [0035] As discussed above, at least two types of serv- 
er are contemplated in a preferred embodiment. The 
first server contemplated is an account management 
server 22 comprising a computer storage medium 32 
and a processing system 34. A database 38 is stored 

55 on the storage medium 32 of the account management 
server 22. The database 38 contains advertiser account 
information. It will be appreciated from the description 
below that the illustrated system and method may be 
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implemented in software that is stored as executable in- 
structions on a computer storage medium, such as 
memories or mass storage devices } on the account 
management server 22. Conventional browser pro- 
grams 1 6, running on client computers 12, may be used 
to access advertiser account information stored on ac- 
count management server 22. Preferably, access to the 
account management server 22 is accomplished 
through a firewall, not shown, which protects the ac- 
count management and search result placement pro- 
grams and the account information from external tam- 
pering. Additional security may be provided via en- 
hancements to the standard communications protocols 
such as Secure HTTP or the Secure Sockets Layer. 
[0036] The second server type contemplated is a 
search engine web server 24. A search engine program 
permits network users, upon navigating to the search 
engine web server URL or sites on other web servers 
capable of submitting queries to the search engine web 
server 24 through their browser program 16, to type key- 
word queries to identify pages of interest among the mil- 
lions of pages available on the World Wide Web. In one 
embodiment, the search engine web server 24 gener- 
ates a search result list that includes, at least in part, 
relevant entries obtained from and formatted by the re- 
sults of the bidding process conducted by the account 
management server 22. The search engine web server 
24 generates a list of hypertext links to documents that 
contain information relevant to search terms entered by 
the user or by the system at the client computer 12. The 
search engine web server transmits this list, in the form 
of a web page, to the network user, where it is displayed 
on the browser 16 running on the client computer 12. A 
presently preferred embodiment of the search engine 
web server may be found by navigating to the web page 
at URL http://www.overture.com/. In addition, the search 
result list web page, an example of which is presented 
in FIG. 7, will be discussed below in further detail. 
[0037] Search engine web server 24 is connected to 
the Internet 20. In one embodiment, search engine web 
server 24 includes a search database 40 comprised of 
search listing records used to generate search results 
in response to user queries. In addition, search engine 
web server 24 may also be connected to the account 
management server 22. Account management server 
22 may also be connected to the internet. The search 
engine web server 24 and the account management 
server 22 address the different information needs of the 
users located at client computers 12. 
[0038] For example, one class of users located at cli- 
ent computers 1 2 may be network information providers 
such as advertising web site promoters or owners hav- 
ing advertiser web pages 30 located on advertiser web 
servers 1 4. These advertising web site promoters, or ad- 
vertisers, may wish to access account information re- 
siding in storage 32 on account management server 22. 
An advertising web site promoter may. through the ac- 
count residing on the account management server 22, 



participate in a competitive bidding process with other 
advertisers. An advertiser may bid on any number of 
search terms relevant to the content of the advertiser's 
web site. In one embodiment, the relevance of a bidded 
5 search term to an advertiser's web site is determined 
through a manual editorial process prior to insertion of 
the search listing containing the search term and adver- 
tiser web site URL into the database 40. In an alternate 
embodiment, the relevance of a bidded search term in 
W a search listing to the corresponding web site may be 
evaluated using a computer program executing at proc- 
essor 34 of account management server 22, where the 
computer program will evaluate the search term and 
corresponding web site according to a set of predefined 
15 editorial rules. In another embodiment, the system, rath- 
er than the advertiser, selects the search term or terms 
relevant to the content of the advertiser's site. 
[0039] The more valuable bids receive more advan- 
tageous placement on the search result list page gen- 
20 erated by the search engine 24 when a search using the 
search term bid on by the advertiser, or associated by 
the system with the advertiser's web site, is executed. 
In one embodiment, the bid by an advertiser comprises 
a money amount that is deducted from the account of 
* the advertiser for each time a specific type of referral to 
that advertiser occurs. Preferentially, that specific type 
of referral Is the click-through referral. Click-through re- 
ferrals are preferable to impression referrals in that ad- 
vertisers generally prefer the former over the latter. 
so Moreover, click-through referrals are preferred to action 
referrals in that recording the former is within the exclu- 
sive control of the search engine web server 24, where- 
as recording the latter requires cooperation of the ad- 
vertiser since actions generally occur on the advertis- 
es er's web site. In this embodiment, bids comprise only 
one element - specifically, the money amount that is de- 
ducted upon the occurrence of a click-through referral. 
A click-through referral occurs when the advertiser's 
web site is accessed via a hyperlink on the search result 
40 list page. A searcher "clicks- on the hyperlink with a 
computer input device to initiate a retrieval request to 
retrieve the information associated with the advertiser's 
hyperlink. Preferably, each access or "click" on a search 
result list hyperlink will be redirected to the search en- 
's gine web server 24 to associate the "click" with the ac- 
count identifier for an advertiser. This redirect action, 
which is not apparent to the searcher, will access ac- 
count identification information coded into the search re- 
sult page before accessing the advertiser's URL using 
so the search result list hyperlink clicked on by the search- 
er The account identification information is recorded in 
the advertiser's account along with information from the 
retrieval request as a retrieval request event. Since the 
information obtained through this mechanism conclu- 
55 slvely matches an account identifier with a URL in a 
manner not possible using conventional server system 
logs known in the art, accurate account debit records 
will be maintained. Most preferably, the advertiser's web 
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site description and hyperlink on the search result list 
page is accompanied by an indication that the advertis- 
er's listing is a paid listing. Most preferably each paid 
listing displays a "cost to advertiser," which is an amount 
corresponding to value of the advertiser's bid for each 
click-through referral to the advertiser's site through the 
search result list. 

[0040] In a second embodiment, the bid by an adver- 
tiser comprises a set of money amounts that are deduct- 
ed from the account of the advertiser for each time cer- 
tain types of referrals to that advertiser occur. Preferen- 
tially, the types of referrals available to the advertiser to 
be bid upon would comprise impression, click-through, 
and a limited set of types of advertiser-defined actions. 
The limited set may comprise two types of actions. In 
that case, a multi-element bid would comprise four ele- 
ments - specifically, the money amounts that are deduct- 
ed, respectively, upon the occurrence of an impression 
referral, a click-through referral, a first action referral, 
and a second action referral. Because the web sites of 
two different advertisers can be very different in pur- 
pose, and because a particular advertiser could have 
very different purposes underlying two different adver- 
tising campaigns, it is preferred that the first and second 
action elements of the bid be advertiser-defined. For ex- 
ample, one advertiser could define the first action as re- 
sponse to a certain promotion, whereas another adver- 
tiser could define the first action as a sale of a good or 
service. 

[0041] An impression referral to an advertiser occurs 
when that advertiser's listing appears in the search re- 
sults listing. In the event of an impression referral to an 
advertiser, the account identification information is re- 
corded in that advertiser's account along with informa- 
tion about the event as an impression referral event. 
Since the information obtained through this mechanism 
conclusively matches an account identifier with a URL 
in a manner not possible using conventional server sys- 
tem logs known in the art, accurate account debit 
records will be maintained. 

[0042] Click-through referrals to advertisers occur 
and are handled as described above in the first embod- 
iment. In alternative embodiments, click-through referral 
processing may be modified according to particular de- 
sign or implementation goals and requirements. 
[0043] An action referral to an advertiser occurs when 
the searcher performs that action associated with the 
advertiser's web site, after the searcher has clicked 
through to the advertiser's web site. Upon receipt of no- 
tification from the advertiser that the action has oc- 
curred, the account identification information is record- 
ed in that advertiser's account along with information 
about the event as a specific action event. Since the in- 
formation obtained through this notification mechanism 
conclusively matches authentication information asso- 
ciated with that advertiser, accurate account debit 
records will be maintained. 

[0044] Notwithstanding the first and second embodi- 



ments above, the disclosure herein addresses all pos- 
sible combinations of referral types upon which to bid. 
By way of example, an embodiment could have adver- 
tisers bidding on only impression referrals and click- 
5 through referrals. This embodiment would provide the 
benefit of having the referral events noticed and record- 
ed by search engine web server 24 without the cooper- 
ation of advertisers. In a second example, another em- 
bodiment could have advertisers bidding on only one ae- 
ro tion referral. This embodiment would provide the benefit 
of aligning with the advertiser interest in paying for highly 
targeted, directed, and specific events. A second class 
of users at client computers 1 2 may comprise searchers 
seeking specific information on the web. The searchers 
15 may access, through their browsers 16, a search engine 
web page 36 residing on web server 24. The search en- 
gine web page 36 includes a query box in which a 
searcher may type a search term comprising one or 
more keywords. Alternatively, the searcher may query 
20 the search engine web server 24 through a query box 
hyperlinked to the search engine web server 24 and lo- 
cated on a web page stored at a remote web server. 
When the searcher has finished entering the search 
term, the searcher may transmit the query to the search 
25 engine web server 24 by clicking on a provided hyper- 
link. The search engine web server 24 will then generate 
a search result list page and transmit this page to the 
searcher at the client computer 1 2. 
[0045] The searcher may click on the hypertext links 
30 associated with each listing on the search results page 
to access the corresponding web pages. The hypertext 
links may access web pages anywhere on the Internet, 
and include paid listings to advertiser web pages 1 8 lo- 
cated on advertiser web servers 1 4. In one embodiment, 
35 the search result list also includes non-paid listings that 
are not placed as a result of advertiser bids and are gen- 
erated by a conventional World Wide Web search en- 
gine, such as the INKTOMI, LYCOS, or YAHOO! search 
engines. The non-paid hypertext links may also include 
40 links manually indexed into the database 40 by an edi- 
torial team. Most preferably, the non-paid listings follow 
the paid advertiser listings on the search results page. 
[0046] FIG. 2 is a diagram showing menus, display 
screens, and input screens presented to an advertiser 
45 accessing the account management server 22 through 
a conventional browser program 1 6. The advertiser, up- 
on entering the URL of the account management server 
22 into the browser program 1 6 of FIG. 1 , invokes a login 
application, discussed below as shown at screen 1 10 of 
50 FIG. 2, running on the processing system 34 of the serv- 
er 22. Once the advertiser is logged-in, the processing 
system 34 provides a menu 120 that has a number of 
options and further services for advertisers. These 
items, which will be discussed in more detail below, 
55 cause routines to be invoked to either implement the ad- 
vertiser's request or request further information prior to 
implementing the advertiser's request, in one embodi- 
ment, the advertiser may access several options 
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through menu 120, including requesting customer serv- 
ice 130, viewing advertiser policies 140, performing ac- 
count administration tasks 1 50,. adding money to the ad- 
vertiser's account 160, managing the account's adver- 
tising presence on the search engine 1 70.. and viewing s 
activity reports 1 80. Context-specific help 1 90 may also 
generally be available at menu 120 and ail of the above- 
mentioned options. 

[0047] The login procedure of the embodiment is 
shown in FIGS. 3 and 4 for two types of user. FIG. 3 io 
shows the login procedures 270 for an advertiser. FIG. 
4 shows the login procedures 290 for an administrator 
managing and maintaining the system and method. As 
discussed above, the advertiser or administrator at a cli- 
ent computer 12 must first use a browser program at 15 
steps 271 or 291 to access the account management 
server. After the advertiser navigates to the URL of the 
login page to start the login process at step 272 or 292, 
the processing system 34 of the account management 
server 22 invokes a login application at steps 274 or 294. 20 
According to this application, the processor provides an 
input screen 1 1 0 (FIG. 2) that requests the advertiser's 
or administrator's user name and password. These 
items of information are provided at steps 276 or 296 to 
a security application known in the art for the purpose 25 
of authentication, based on the account information 
stored in a database stored in storage 32 of account 
management server 22. 

[0048] According to FIG. 3, after the user has been 
authenticated as an advertiser, the advertiser is provid- 30 
ed with the menu screen 1 20 of FIG. 2 and limited read/ 
write access privileges only to the corresponding adver- 
tiser account, as shown in step 278. The advertiser login 
event 278 may also be recorded in step 280 in an audit 
trail data structure as part of the advertiser's account 35 
record in the database. The audit trail is preferably im- 
plemented as a series of entries in database 38, where 
each entry corresponds to an event wherein the adver- 
tiser's account record is accessed. Preferably, the audit 
trail information for an account record may be viewed *o 
by the account owner and other appropriate administra- 
tors. 

[0049] However, if the user is authenticated as an ad- 
ministrator in step 295 of FIG. 4, the administrator is pro- 
vided with specified administrative access privileges to 45 
all advertiser accounts as shown in step 296. The ad- 
ministrator login event 296 is recorded in step 297 in the 
audit trail data structure portion of the administrator's ac- 
count record. This audit trail is preferably implemented 
as a series of entries in database 38, where each entry so 
corresponds to an event wherein the administrator's ac- 
count record is accessed. Most preferably, the adminis- 
trator's audit trail information may be viewed by the ac- 
count owner and other appropriate administrators. 
[0050] Furthermore, instead of the general advertiser ss 
main menu shown to the authenticated advertiser users 
in step 282, the authenticated administrator is provided 
in step 298 with access to search the database 38 of 



advertiser accounts. Preferably, a database search in- 
terface is provided to the administrator that enables the 
administrator to select an advertiser account to monitor. 
For example, the interface may include query boxes in 
which the administrator may enter an account number 
or usemame or contact name corresponding to an ac- 
count the administrator wishes to access. When the ad- 
ministrator selects an advertiser account to monitor in 
step 299, the administrator is then brought to the main 
advertiser page 120 of FIG. 2, which is also seen by the 
advertisers. 

[0051] Access to the account information 32 located 
on the account management server 22 is restricted to 
users having an account record on the system, as only 
those users are provided with a valid login name and 
password. Password and login name information is 
stored along with the user's other account information 
in the database 38 of the account management server 
22, as shown in FIG. 1 . Account information, including 
a login user name and password, is entered in the da- 
tabase 38 of FIG. 1 via a separate online registration 
process that is outside the scope of the present disclo- 
sure. 

[0052] FIG. 5 is a diagram showing the types of infor- 
mation contained in each advertiser account record 300 
in the database. First, an advertiser account record 300 
contains a usemame 302 and a password 304, used for 
online authentication as described above. The account 
record also contains contact information 31 0. Examples 
of contact information include a contact name, company 
name, street address, phone, e-mail address. 
[0053] Contact information 310 is preferably utilized 
to direct communications to the advertiser when the ad- 
vertiser has requested notification of key advertiser 
events under the notification option, discussed below. 
The account record 300 also contains billing information 
320 such as a current balance and credit card informa- 
tion. The billing information 320 contains data accessed 
when the advertiser selects the option to add money to 
the advertiser's account. In addition, certain billing infor- 
mation, such as the current balance, may trigger events 
requiring notification under the notification option. The 
audit trail section 325 of an account record 300 contains 
a list of all events wherein the account record 300 is ac- 
cessed. Each time an account record 300 is accessed 
or modified, by an administrator or advertiser a short en- 
try describing the account access and/or modification 
event will be appended to the audit trail section 330 of 
the administrator or advertiser account that initiated the 
event. The audit trail information may then be used to 
help generate a history of transactions made by the ac- 
count owner under the account. 
[0054] The advertising information section 330 con- 
tains information needed to conduct the online bidding 
process, wherein a position is determined for a web site 
description and hyperlink within a search result list gen- 
erated by a search engine. The advertising data 330 for 
each user account 300 may be organized as zero or 
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more subaccounts 340. Each subaccount 340 compris- 
es at least one search listing 344. Each search listing 
corresponds to a bid on a search term. An advertiser 
may utilize subaccounts to organize multiple bids on 
multiple search terms, or to organize bids for multiple 
web sites. Subaccounts are also particularly useful for 
advertisers seeking to track the performance of targeted 
market segments. The subaccount superstructure is in- 
troduced for the benefit of the advertisers seeking to or- 
ganize their advertising efforts, and does not affect the 
method of operation of the embodiments described 
herein. Alternatively, the advertising information section 
need not include the added organizational layer of sub- 
accounts, but may simply comprise one or more search 
listings. 

[0055] The search listing 344 corresponds to a search 
term/bid pairing and contains key information to conduct 
the online competitive bidding process. Preferably, each 
search listing comprises the following information: 
search term 352, web site description 354, URL 356 ! bid 
element amounts 358, and a title 360. Additional infor- 
mation may be added or some of this information may 
be deleted or re-cast according to particular design 
goals. The search term 352 comprises one or more key- 
words which may be common words in English or any 
other language. Each keyword in turn comprises a char- 
acter string. The search term is the object of the com- 
petitive online bidding process. The advertiser selects 
a search term to bid on that is relevant to the content of 
the advertiser's web site. Ideally, the advertiser may se- 
lect a search term that is targeted to terms likely to be 
entered by searchers seeking the information on the ad- 
vertiser's web site, although less common search terms 
may also be selected to ensure comprehensive cover- 
age of relevant search terms for bidding. 
[0056] In an alternative embodiment, the system, in- 
stead of the advertiser, selects the search term or terms 
related to the advertiser's web site. Certain advertisers 
may prefer to be saved the work of determining these 
keywords. Moreover, to the extent the system allows the 
advertiser to bid on action events, and the advertiser 
bids only on action events, the advertiser has less in- 
centive to be concerned about compiling an accurate 
search term list related to its web site. Since that adver- 
tiser pays only upon the occurrence of the action , that 
advertiser may have less incentive to have its web site 
associated with as many different search terms as pos- 
sible, even entirely unrelated search terms. In cases like 
this, the system would preferably select the search 
terms appropriate to that advertiser's web site in order 
to maximize relevance of the search results. 
[0057] The web site description 354 is a short textual 
description, preferably less than 190 characters, of the 
content of the advertiser's web site and may be dis- 
played as part of the advertiser's entry in a search result 
list. The search listing 344 may also contain a title 360 
of the web site that may be displayed as the hyperlinked 
heading to the advertiser's entry in a search result list. 



The URL 356 contains the Uniform Resource Locator 
address of the advertiser's web site. When the user 
clicks on the hyperlink provided in the advertiser's 
search result list entry, the URL is provided to the brows- 

5 er program. The browser program, in turn, accesses the 
advertiser's web site through the redirection mechanism 
discussed above. The URL may also be displayed as 
part of the advertiser's entry in a search result list. 
[0058] In one embodiment there is only a single bid 

io element amount 358 corresponding, preferably, to a 
click-through event. In this embodiment bid element 
amount 358 is a money amount bid by an advertiser for 
a listing. This money amount is deducted from the ad- 
vertiser's prepaid account or is recorded for advertiser 

15 accounts that are invoiced for each time a search is ex- 
ecuted by a user on the corresponding search term and 
the search result list hyperlink is used to refer the 
searcher to the advertiser's web site. 
[0059] In a second embodiment, there are multiple bid 

20 element amounts 358. These multiple bid element 
amounts correspond to one or more of an Impression 
event, a click-through event, and one or more action 
events. Multiple bid element amounts 358 correspond- 
ing to all of an impression event, a click-through event, 

25 and one or more action events will be discussed. 

[0060] Bid element amount 358 associated with an 
Impression event is the money amount deducted from 
the advertiser's pre-paid account upon the occurrence 
of that event. Bid element amount 356 associated with 

30 a click-through event is the money amount deducted 
from the advertiser's pre-paid account upon the occur- 
rence of that event. Bid element amounts 358 associat- 
ed with action events are the money amounts deducted 
from the advertiser's pre-paid account upon the system 

35 receiving notification of the occurrence of the applicable 
action event. 

[0061] Finally, a rank value is a value generated dy- 
namically, preferably by the processing system 34 of the 
account management server 22 shown in FIG. 1 , each 

40 time an advertiser places a bid or a searcher enters a 
search query. The rank value of an advertiser's search 
listing helps to determine the placement location of the 
advertiser's entry in the search result list generated 
when a search is executed on the corresponding search 

45 term. Preferably, rank value is an ordinal value deter- 
mined in a direct relationship to the bid value 358; the 
higher the bid value, the higher the rank value, and the 
more advantageous the placement location on the 
search result list. In one embodiment, the rank value of 

so ^ is assigned to the highest bid value with successively 
higher ordinal values (e.g., 2, 3, 4, ...) associated with 
successively lower ranks and assigned to successively 
lower bid values. Under an alternative preferred embod- 
iment, the bid values are used in combination with one 

55 or more other factors in determining rank value. As an 
example of other factors, certain measures of relevance 
that are independent of the bid value could be used. 
[0062] In one embodiment, in which there is only a sin- 
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gle bid element amount 358, the bid value is the value 
of the bid element amount 358. Preferably, this value is 
determined simply by using the exact amount of the bid 
element as its value. This method of determination has 
the benefit of simplicity and clarity. 
[0063] Alternatively, and also preferably, the value of 
bid element amount 358 can be determined by calculat- 
ing the market value of that amount. Market value of the 
amount is calculated as the product of the amount and 
the probability of occurrence of the referral event with 
which this bid element is associated. In this embodi- 
ment, that referral event is a click-through. Accordingly, 
the probability to be calculated is the probability of a 
click-through. Calculating market value of the bid ele- 
ment amount has the benefit of more accurately valuing 
the placement locations on the search result list. 
[0064] One way to determine the probability of a click- 
through for a particular listing is to use the click through 
rate over a specified period of time. In one embodiment, 
click through rate is defined as the ratio of the Number 
of Clicks to the Number of Impressions. Preferably, the 
probability of a click-through for a particular listing is cal- 
culated taking into consideration the higher average 
click-through rates ( M CTR M ) of more prominent positions 
in the search results, and the lower average CTR of less 
prominent positions. More preferably, the calculation of 
the probability of a click-through for a particular listing 
also takes into account the comparative attractiveness 
of that particular listing relative to its competition. 
[0065J Most preferably, the probability of a click- 
through for a particular listing is calculated as the prod- 
uct of the expected CTR for the contemplated position 
of the listing when occupied by a listing of average at- 
tractiveness to the user, and a number representing the 
rank-independent comparative attractiveness of the 
particular listing relative to the average listing for that 
term. This comparative attractiveness factor distin- 
guishes between a listing of less than average attrac- 
tiveness, for which this factor would be less than one, a 
listing of typical or average attractiveness, for which this 
factor would be one, and a listing of unusual attractive- 
ness, for which this factor is greater than one. 
[0066] By way of example, consider a listing of inter- 
est to only a small fraction of users who perform a par- 
ticular search. One example of such a listing is a listing 
for a service that provides cross-country sh ipping for au- 
tomobiles, when matched to a user search for "cars". 
Only a small fraction of users performing a search on 
"cars" have an interest in shipping an automobile at that 
time. Many users read the title and the description com- 
ponents of the listing provided by the advertiser before 
deciding to click through to the listed site. Most of those 
users will skip that listing, and some fraction of them will 
bother to read on for another listing that addresses the 
aspect of "cars" that matches or catches their interest. 
Only those users who are interested in transporting an 
automobile, plus that fraction of users who don't read 
the titles and descriptions of listings before clicking, will 



click through to the listed site, 

[0067] This behavior is as intended by the advertiser, 
who crafts the title and description of the listing to en- 
courage users who are likely to respond to the proposi- 

5 tions of the advertiser's web site to click on the listing, 
with consequent cost to the advertiser and conversely, 
to discourage users from clicking whose expected busi- 
ness value is less than the cost due to the search engine 
operator for the click through. The incentive for an ad- 

10 vertiser to represent accurately the nature of a listed 
web page is one of the advantages of a cost per click 
element in the cost of advertiser participation. 
[0068] However, this listing's less-than-typical CTR at 
a given position in the search results for "cars*, corn- 
's pared to a typical listing matching "cars", means that the 
market value of this listing must be adjusted down rela- 
tive to those typical listings. This adjustment is repre- 
sented by the comparative attractiveness factor de- 
scribed above. 

20 [0069] Preferably, the comparative attractiveness fac- 
tor for a listing is calculated as a normalized probability. 
This normalized probability is equal to the ratio of the 
CTR for that listing over a specified period of time, and 
the average expected or intrinsic CTR applicable to the 

25 various rankings held by that listing over the same pe- 
riod of time. Calculated this way, the comparative attrac- 
tiveness factor references how the listing performed 
with respect to attracting click-throughs, relative to how 
the listing should have performed given the rankings it 

30 held. How the listing should have performed is captured 
by the intrinsic CTR value. 

[0070] Intrinsic CTR applicable to a particular ranking 
refers to the fact that, over a sufficient number of search- 
es, an average CTR for all listings that held that ranking 

35 can be calculated. This calculated average CTR is con- 
sidered the intrinsic CTR applicable to that ranking. For 
a listing of average attractiveness, the CTR expected 
for that listing at a particular ranking is equal to the in- 
trinsic CTR applicable to that ranking. Intrinsic CTR can 

*o be calculated for each search term, for certain groups 
or categories of search terms, or most simply, across 
all search terms. 

[0071] In calculating the denominator of the normal- 
ized probability for a listing, an average intrinsic CTR 

6 value is used. That average intrinsic CTR value con- 
cerns the fact that over a period of time, a listing can 
hold various rankings. Each of those rankings has its 
own intrinsic CTR. There are a number of alternative 
preferable methods for calculating the average intrinsic 

*o CTR value which is used as the denominator of the nor- 
malized probability. Under one such method, the de- 
nominator is calculated as the ratio of the sum of all of 
the intrinsic CTRs applicable to all of the rankings held 
by the listing over a period of time, and the number of 

» impressions of that listing over the same period of time. 
Under a second preferable method, the average of all 
the rankings held by the listing over a period of time is 
first calculated. Then, the denominator of the normai- 
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ized probability is set to the intrinsic CTR applicable to 
that calculated average ranking. Underthts method, the 
average ranking will tend not to be an integer. In accord- 
ance with the embodiments herein, various devices and 
techniques can be used for handling this situation. One 5 
way is to use, as the average ranking in the calculation 
of the average intrinsic CTR value, the integer closest 
to the calculated average ranking. Alternatively, intrinsic 
CTR can be expressed as a continuous function, there- 
by accommodating the concept of fractional rankings. io 
[0072] Once the normalized probability has been cal- 
culated, the market value of bid element amount 358 for 
a listing can now be calculated. That market value is cal- 
culated as the product of bid element amount 358, the 
intrinsic CTR for the contemplated position of the listing, *s 
and the normalized probability for the listing. This cal- 
culation results in a money amount that the advertiser 
is expected to pay upon the completion of the next 
search in which this listing is included. As such, these 
money amounts for all listings for each search term can 
be sorted by the amounts, and the listings can be as- 
signed ordinal rank values. 

[0073] Most preferably, the market value of bid ele- 
ment amount 358 for a listing is calculated as the prod- 
uct of bid element amount 358 and the normalized prob- 
ability for the listing. In the preferred embodiment, the 
intrinsic CTR for the contemplated position of the listing 
is not used in the computation of market value. The rea- 
son for this is that this value does not change the rank- 
ing. In other words, the ranking determined by the prod- 
uct of bid element amount 358 and the normalized prob- 
ability is the same as the ranking determined by the 
product of those two values and the intrinsic CTR for the 
contemplated position of the listing. Accordingly, com- 
puting the latter value is unnecessary. 
[0074] In the preferred embodiment, the market value 
is a normalized value of bid element 358. This normal- 
ized value is expressed in units of "cost-per-click* 
("CPC"), just as is the non-normalized bid element 
amount 358. The difference between the two is that the 
normalized value takes into account the comparative at- 
tractiveness of the listings. If a listing is more attractive 
than average as demonstrated by the click-through be- 
havior of searchers, then for the purposes of ranking, 
the market value of bid element amount 358 for that list- 
ing will be higher than that amount. Conversely, if the 
listing is less attractive than average, then for the pur- 
poses of ranking the market value will be less than the 
actual bidded amount. The normalized value resolves 
the problem illustrated by the example above concern- 
ing searches for "cars". The normalized value repre- 
sents a bid for a listing of average attractiveness that is, 
from the point of view of the search engine, monetarily 
equivalent to bid element 358 for the current listing. The 
normalized value allows the bids for all listings to be 
compared as if all listings were of average attractive- 
ness. In a second embodiment, there are multiple bid 
element amounts 358 corresponding, preferably, to an 



impression event, a click-through event, and one or 
more action events. In this embodiment, the bid value 
is calculated as a combination of the values of each of 
the bid elements. In one embodiment, the combination 
is a sum. 

[0075] Preferably, the value of a bid element corre- 
sponding to an impression event is determined simply 
as the actual amount of the bid element, since the prob- 
ability of occurrence of the impression event is 1 if the 
listing is selected for display. 

[0076] The value of a bid element corresponding to a 
click-through event is determined as described above 
in connection with one embodiment. 
[0077] Finally, the value of a bid element correspond- 
ing to an action event is calculated as the product of the 
amount of the bid element and the probability of occur- 
rence of the action event with which this bid element is 
associated. One way to determine this probability is to 
use the action rate over a specified period of time. In 
one embodiment, the action rate is defined to be the 
number of actions to the number of impressions. Be- 
cause actions generally occur on the advertiser's web 
site, the probability of the action event can be treated 
as independent of the particular ranking of the listing that 
led to the action. 

[0078] Most preferably, the probability of an action for 
a particular listing would be calculated as the ratio of the 
action rate for that listing over a specified period of time, 
and the intrinsic CTR applicable to the average ranking 
of that listing over the same period of time. Calculating 
this ratio achieves a normalization of the action rate for 
the listing. Although the probability that the user will per- 
form the action on the advertiser's web site after the user 
has clicked through to that web site is independent of 
the ranking of the listing that led to the action, the rank- 
ing does in fact affect the number of opportunities there 
were for that action to have occurred. This normalizing 
ratio is necessary to put different bids on equal footing 
with respect to opportunities for the actions to occur. In 
this way comparisons between different bids are based 
on truer relative values of the respective bids. 
[0079] Most preferably, in calculating the value of mul- 
tiple bid element amounts 358 as the sum of the values 
of each of the bid elements, the value of each bid ele- 
ment is expressed in consistent units. One way to do so 
is to calculate the value of each bid element in CPC 
units. CPC units are achieved in valuing the bid element 
amount for a click-through as the product of that amount 
and the normalized probability, as described above. 
Similarly, CPC units are achieved in valuing the bid el- 
ement amount for an action as the product of that 
amount and the normalizing ratio, also as described 
above. These two values can be added, and the result 
will still be expressed in CPC units. However, the bid 
element amount for impression is expressed in cost-per- 
impression f CPM") units. In order to add the value of 
this bid element amount to the values of other amounts 
which are expressed in CPC units, a transformation 
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must first be applied to the bid element amount for im- 
pression. 

[0080] One preferable transformation is to divide the 
bid element amount for impression by the intrinsic CTR 
applicable to a particular ranking R for the search term 
to which the current listing applies. For example, if R is 
1 , then the particular ranking is ranking number 1 . Then, 
if the bid element amount for impression is divided by 
the intrinsic CTR for ranking 1 , the resultant value is ex- 
pressed in CPC units. Specifically, in this example, the 
resultant value will be equivaientto the amount of a CPC 
bid for a listing of average attractiveness, where that 
amount would have achieved a number 1 ranking. Now 
if this transformed value of the bid element amount for 
an impression is added to the normalized values of the 
bid element amounts for click-through and for one or 
more actions, then the resultant value will be expressed 
in CPC units. This resultant value will resolve the -at- 
tractiveness" problem described above. 
[0081] In accordance with the illustrated embodi- 
ments, any ranking R can be used, so long as the same 
R is used for ail listings for a particular search term. In 
this way, consistent "apples to apples" comparisons of 
value can be made between the multiple element bids 
of different listings. In the above example, where R is 1 , 
the least amount of weight is accorded the bid for im- 
pression as against the bids for click-through or for ac- 
tions. The larger the R, the higher the relative weight is 
accorded the bid for impression in valuing the entire mul- 
tiple element bid. 

[0082] The foregoing calculation allows not only for 
consistent "apples to apples" comparisons to be made 
between different bids, but also for a precise meaning 
to be attributed to each bid. That meaning is the "mon- 
etarily equivalent bid for click-through for a listing of av- 
erage attractiveness". In other words, each multi-ele- 
ment bid is transformed into the monetarily equivalent 
bid for click-through for a listing of average attractive- 
ness. 

[0083] The foregoing describes calculating the value 
of multiple bid element amounts 358 in units of "effective 
CPC". Equivalent^, the value of multiple bid element 
amounts 358 could be calculated in units of "effective 
CPJvT, instead of effective CPC. The effective CPM val- 
ue of a multiple element bid is calculated as the product 
of the effective CPC value of that bid and the intrinsic 
CTR applicable to the same ranking R used in calculat- 
ing effective CPC. The effect on ranking is exactly the 
same. Similarly, other, equivalent, "effective values" 
could be used. 

[0084] When the system of the present embodiments 
receives notification of the occurrence of an action, the 
system records that occurrence. When the action oc- 
curs within the system, the system can generate that 
notification. Sometimes, however, actions occur on the 
advertiser's web site. In those cases, the advertiser 
must either send notification of the action event, or per- 
mit the system to have access to the advertiser's web 



site to generate the notification, in order for the event to 
be recorded by the system. In the case where notifica- 
tion is to be sent by the advertisers, advertisers will have 
an incentive to provide this notification. If an advertiser 
5 never sends notification of action events that occurred, 
then the action rate will be calculated as 0, and so the 
value of the bid element tor that action will be treated 
also as 0. In that case, it does not matter what amount 
what the advertiser bids for that action. If the action nev- 

*0 er occurs according to the understanding of the system, 
then that bid element is valued at 0. In this way. the 
present embodiment provides sufficient incentive forthe 
system to work as designed. In an alternative embodi- 
ment, suitable method or apparatus could be imple- 
mented to cause the notification to be sent by the user's 
browser operating on the user's personal computer or 
other device, rather than having to receive it from the 
advertiser. Generally the advertiser would have to co- 
operate to enable such an embodiment. Once logged 

20 in, an advertiser can perform a number of straightfor- 
ward tasks set forth in menu 120 of FIG. 2, including 
viewing a list of rules and policies for advertisers, and 
requesting customer service assistance. These items 
cause routines to be invoked to implement the request. 

25 For example, when "Customer Service" is selected, an 
input screen 130 is displayed to allow the advertiser to 
select the type of customer service requested. In addi- 
tion, forms may be provided on screen 130 so that an 
advertiser may type a customer comment into a web- 

30 based input form. 

[0085] When "View Advertiser Policies" is selected, a 
routine will be invoked by processing system 34 of the 
account management server 22 FIG. 1. As shown in 
FIG. 2, the routine will display an informational web page 

35 1 40. The web page 1 40 sets forth the advertiser policies 
currently in effect. One examples is, "All search listing 
descriptions must clearfy relate to the search term." 
[0085] Menu 1 20 of FIG. 2 also includes an "Account 
Administration" selection 1 50 which allows an advertis- 

40 er, among other things, to view and change the adver- 
tiser's contact information and billing information, or up- 
date the advertisers access profile, if any. Web-based 
forms well known in the art and similar to those dis- 
cussed above are provided for updating account infor- 

45 mation. 

[0087] The "Account Administration" menu also in- 
cludes a selection enabling an advertiser to view the 
transaction history of the advertiser's account. Under 
the "View Transaction History" selection, the advertiser 

50 may invoke routines to view a listing of past account 
transactions. Examples include adding money to ac- 
count, adding or deleting bidded search terms, or 
changing bid eiement amounts. Additional routines may 
be implemented to permit advertisers to display a history 

55 of transactions of a specified type, or that occur within 
a specified time. The transaction information may be ob- 
tained from the audit trail fist 325 of FIG. 5, described 
above. Clickable buttons that may be implemented in 



13 

JNSDOCJD:<EP _1282051A1J > 



25 



EP 1 282 051 A1 



26 



software, web-based forms., and/or menus may be pro- 
vided as known in the art to enab le advertisers to specify 
such limitations. 

[0088] In addition, the "Account Administration" menu 
150 of FIG. 2 includes a selection enabling an advertiser 
to set notification options. Under this selection, the ad- 
vertiser may select options that will cause the system to 
notify the advertiser when certain key events have oc- 
curred. For example, the advertiser may elect to set an 
option to have the system send conventional electronic 
mail messages to the advertiser when the advertiser's 
account balance has fallen below a specified level. In 
this manner, the advertiser may receive a "warning" to 
replenish the account before the account is suspended 
In one embodiment, when the account is suspended, 
the advertiser's listings will no longer appear in search 
result lists. Another key event for which the advertiser 
or web site promoter may wish notification Is a change 
in position of an advertiser's listing in the search result 
list generated for a particular search term. For example, 
an advertiser may wish to have the system send a con- 
ventional electronic mail message to the advertiser if the 
advertiser has been outbid by another advertiser for a 
particular search term. In one embodiment, when the 
advertiser has been outbid, the advertiser's listing will 
appear In a position farther down on the search result 
list page than previously. When one of the system-spec- 
ified key events occurs, a database search is triggered 
for each affected search listing. The system will then ex- 
ecute the appropriate notification routine in accordance 
with the notification options specified in the advertiser's 
account. 

[0089] Referring back to FIG. 2, a selection also ap- 
pears in menu 120 that permits an advertiser to add 
money to the advertiser's account, so that the advertiser 
will have funds in their account to pay for referrals to the 
advertiser through the search results page. Preferably, 
only advertisers with funds in their advertiser's accounts 
may have theirpaid listings included in any search result 
lists generated. Most preferably, advertisers meeting 
selected business criteria may elect, in place of main- 
taining a positive account balance at ail times, incur ac- 
count charges regardless of account balance and pay 
an invoiced amount at regular intervals which reflects 
the charges incurred by actual referrals to the advertiser 
generated by the search engine. The process that is ex- 
ecuted when the "Add Money to Account" selection is 
invoked is shown in further detail in FIG. 6, beginning at 
step 602. When the "Add Money to Account" selection 
is clicked in step 604, a function is invoked which re- 
ceives data identifying the advertiser and retrieves the 
advertiser's account from the database. The executing 
process then stores the advertiser's default billing infor- 
mation and displays the default billing information forthe 
advertiser in step 606. The displayed billing information 
includes a default amount of money to be added, a de- 
fault payment type, and default instrument information. 
[0090] In one embodiment, an advertiser may add 



funds online and substantially in real time through the 
use of a credit card, although the use of other payment 
types are certainly well within the scope of the present 
embodiments. For example, in an alternate embodi- 
5 ment, advertisers may add funds to their account by 
transferring the desired amount from the advertiser's 
bank account through an electronic funds verification 
mechanism known in the art such as debit cards, in a 
manner similar to that set forth in U S Pat. No. 5724,424 
10 to Gifford. In another alternate embodiment, advertisers 
can add funds to their account using conventional pa- 
per-based checks. In that case, the additional funds may 
be updated in the account record database through 
manual entry. The instrument information includes fur- 
is ther details regarding the type of payment. For example, 
for a credit card, the instrument information may include 
data on the name of the credit card, such as Master- 
Card, Visa, or American Express, the credit card 
number, the expiration date of the credit card, and billing 
20 information for the credit card, such as billing name and 
address. In one embodiment, only a partial credit card 
number is displayed to the advertiser for security pur- 
poses. 

[0091 ] The default values displayed to the advertiser 

25 are obtained from a persistent state, e.g., stored in the 
account database, in an embodiment, the stored billing 
information values may comprise the values set by the 
advertiser the last or most recent time the process of 
adding money was invoked and completed for the ad- 

30 vertiser's account. The default billing information is dis- 
played to the advertiser in a web-based form. The ad- 
vertiser may click on the appropriate text entry boxes on 
the web-based form and make changes to the default 
billing information. After the advertiser completes the 

35 changes, the advertiser may click on a hyperiinked 
"Submit 1 button provided on the form to request that the 
system update the billing information and current bal- 
ance in step 608. Once the advertiser has requested an 
update, a function is invoked by the system which vali- 

40 dates the billing information provided by the advertiser 
and displays it back to the advertiser for confirmation, 
as shown in step 610. The confirmation billing informa- 
tion is displayed in read-only form and may not be 
changed by the advertiser. 

45 [0092] The validation step functions as follows. If pay- 
ment is to be debited from an advertiser's external ac- 
count, payment may be authenticated, authored and 
completed using the system set forth in U.S. Pat. No. 
5724,424 to Gifford. However, if the payment type is by 

so credit card, a validating algorithm is invoked by the sys- 
tem, which validates the credit card number using a 
method such as that set forth in U.S. Patent No. 
5.836,241 to Stein et al. The validating algorithm also 
validates the expiration date via a straightforward com- 

55 parison with the current system date and time. In addi- 
tion, the function stores the new values in a temporary 
instance prior to confirmation by the advertiser. 
[0093] Once the advertiser ascertains that the dis- 
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played data is correct, the advertiser may click on a 
"Confirm" button provided on the page to indicate that 
the account should be updated in step 612. In step 612, 
a function is invoked by the system which adds money 
to the appropriate account balance, updates the adver- s 
tiser's billing information, and appends the billing infor- 
mation to the advertiser's payment history. The adver- 
tiser's updated billing information is stored to the per- 
sistent state in the account record database from the 
temporary instance. 10 
[0094] Within the function invoked at step 61 2, a credit 
card payment function may be invoked by the system at 
step 614. In an alternate embodiment other payment 
functions such as debit card payments may be invoked 
by defining multiple payment types depending on the >s 
updated value of the payment type. 
[0095] If the payment type is credit card, the user's 
account is credited immediately at step 616, the user's 
credit card having already been validated in step 610. 
A screen showing the status of the add money transac- 20 
tion is displayed, showing a transaction number and a 
new current balance, reflecting the amountadded by the 
just-completed credit card transaction. 
[0096] in an alternate embodiment, after the money 
has been added to the account, the amount of money 25 
added to the account may be allocated between subac- 
counts the end of the add money process at step 616. 
If the advertiser has no subaccounts, ail of the money 
in the account is a general allocation. However, if the 
advertiser has more than one subaccount, the system 30 
will display a confirmation and default message prompt- 
ing the advertiser to "Allocate Money Between Subac- 
counts". 

[0097] The menu selection "Allocate Money Between 
Subaccounts" may be invoked when money is added to 3$ 
the advertiser account after step 616 of FIG 6, or it may 
be invoked within the "Account Management 1 ' menu 1 70 
shown in FIG 2. The "Account Management" menu 1 70 
is accessible from the Advertiser Main Page 120, as 
shown in FIG. 2. This "Allocate Money Between Subac- 40 
counts" menu selection permits an advertiser to allocate 
current and any pending balances of the advertiser's ac- 
count among the advertiser's subaccounts. The system 
will then update the subaccount balances. The current 
balance allocations will be made in real time, while the 45 
pending balance allocations will be stored in the persist- 
ent state. A routine will be invoked to update the subac- 
count balances to reflect the pending balance alloca- 
tions when the payment for the pending balance is proc- 
essed. Automatic notification may be sent to the adver- so 
tiser at that time, if requested. This intuitive online ac- 
count management and allocation permits advertisers 
to manage their online advertising budget quickly and 
efficiently. Advertisers may replenish their accounts with 
funds and allocate their budgets, all in one easy web- ss 
based session. The computer-based implementation 
eliminates time consuming, high cost manual entry of 
the advertiser's account transactions. 



[0098] The "Allocate Money Between Subaccounts" 
routine begins when an advertiser indicates the intent 
to allocate money by invoking the appropriate menu se- 
lection at the execution points indicated above. When 
the advertiser indicates the intent to allocate, a function 
is invoked by the system to determine whether there are 
funds pending in the current balance, such as unactivat- 
ed account credits, that have not yet been allocated to 
the advertiser's subaccounts, and displays the balance 
selection options. In an embodiment, an account in- 
stance is created and a pending current balance ac- 
count field is set from the persistent state. 
[0099] If there are no unallocated pending funds, the 
system may display the current available balances for 
the account as a whole as well as for each subaccount. 
The advertiser then distributes the current available bal- 
ance between subaccounts and submits a request to 
update the balances. A function is invoked which calcu- 
lates and displays the current running total for subac- 
count balances. The current running total is stored in a 
temporary variable which is set to the sum of current 
balances for all subaccounts for the specified advertiser. 
The function also validates the new available subac- 
count balances to make sure that the total does not ex- 
ceed the authorized amount. If the new advertiser-set 
available subaccount balances does not exceed the au- 
thorized amount, a function is invoked which will update 
all of the subaccount balances in the persistent state 
and display the update in read-only format. 
[0100] If there are pending funds in the current ac- 
count balance, the pending funds must be allocated 
separately from the available current balance. The 
pending funds will then be added into the available cur- 
rent balance when the funds are received. The function 
must therefore prompt the advertiserto choose between 
allocating pending funds or allocating available funds. 
The allocating pending funds selection works in much 
the same manner as the allocating available funds se- 
lection outlined above. After the advertiser chooses to 
allocate pending funds, a routine is invoked to display 
current pending balances for the account and the sub- 
accounts. The advertiser distributes the pending subac- 
count balances between campaigns and submits a re- 
quest to update the balances. A function is invoked 
which calculates and displays the current running totals 
for the pending subaccount balances. This function also 
validates the new pending subaccount allocations to 
make sure that the allocations do not exceed any au- 
thorized amount. The current running total of pending 
allocations is set to the sum of current pending balances 
for all subaccounts for the advertiser If the new user- 
set pending subaccount balances or the totai of such 
balances do not exceed any authorized amount, the 
function will update all of the pending subaccount allo- 
cations in the persistent state, e.g. the advertiser's ac- 
count in the database, and display the update in read- 
only format. 

[0101] As indicated above and shown in FIG. 2. a rou- 
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tine displaying the account management menu 1 70 may 
be invoked from the advertiser main menu 120. Aside 
from the "Allocate Money Between Subaccounts" selec- 
tion described above, the remaining selections all use 
to some extent the search listings present in the adver- 
tiser's account on the database, and may also affect the 
advertiser's entry in the search result list Thus, a further 
description of the search result list generated by the 
search engine is needed at this point. 
[01 02] When a remote searcher accesses the search 
query page on the search engine web server 24 and ex- 
ecutes a search request according to the procedure de- 
scribed previously, the search engine web server 24 
preferably generates and displays a search result list 
where the "canonicalized" entry in search term field of 
each search listing in the search result list exactly 
matches the canonicalized search term query entered 
by the remote searcher. The canonicalization of search 
terms used in queries and search listings removes com- 
mon irregularities of search terms entered by searches 
and web site promoters, such as capital letters and pe- 
nalizations, in order to generate relevant results. How- 
ever, alternate schemes for determining a match be- 
tween the search term field of the search listing and the 
search term query entered by the remote searcher are 
well within the scope of the present embodiments. For 
example, string matching algorithms known In the art 
may be employed to generate matches where the key- 
words of the search listing search term and the search 
term query have the same root but are not exactly the 
same, such as computing vs. computer. Alternatively a 
thesaurus database of synonyms may be stored at 
search engine web server 24, so that matches may be 
generated for a search term having synonyms. Locali- 
zation methodologies may also be employed to refine 
certain searches. For example, a search for "bakery" or 
"grocery store" may be limited to those advertisers with- 
in a selected city, zip code, or telephone area code. This 
information may be obtained through a cross-reference 
of the advertiser account database stored at storage 32 
on account management server 22. Finally, internation- 
alization methodologies may be employed to refine 
searches for users outside the United States. For exam- 
pie, country or language-specific search results may be 
generated, by a cross-reference of the advertiser ac- 
count database, for example. . 
[01 03] An example of a search result list display used 
in one embodiment is shown in FIG 7, which is a display 
of the first several entries resulting from a search for the 
term "zip drives". As shown in FIG. 7, a single entry, such 
as entry 71 0a in a search result list consists of a descrip- 
tion 720 of the web site, preferably comprising a title and 
a short textual description, and a hyperlink 730 which, 
when clicked by a searcher, directs the searcher's 
browser to the URL where the described web site is lo- 
cated. The URL 740 may also be displayed in the search 
result list entry 710a, as shown in FIG. 7. An "impres- 
sion" referral of a search result item occurs when that 



item is displayed to the searcher, as shown in FIG. 7. A 
"click through" referral of a search result item occurs 
when the remote searcher viewing the search result 
item display 71 0 of FIG. 7 selects, or "clicks" on the hy- 

5 perlink 730 of the search result item display 71 0. In order 
for a "click through'* to be completed, the searcher's click 
should be recorded at the account management server 
and redirected to the advertiser's URL via the redirect 
mechanism discussed above. An "action" referral of a 

io search result Item occurs, after the searcher has been 
redirected to the advertiser's URL, when the searcher 
performs the specified action associated with the adver- 
tiser's web site. 

[0104] Search result list entries 71 0a - 71 Oh may also 
*5 show the rank value of the advertiser's search listing. 
The rank value is an ordinal value, preferably a number, 
generated and assigned to the search listing by the 
processing system 34 of FIG. 1 . Preferably, the rank val- 
ue is assigned through a process, implemented in soft- 
20 ware, that establishes an association between the bid 
value, the rank, and the search term of a search listing. 
The process gathers all search listings that match a par- 
ticular search term, sorts the search listings in order 
from highest to lowest bid value, and assigns a rank val- 
2s ue to each search listing in order. The highest bid value 
receives the highest rank value, the next highest bid val- 
ue receives the next highest rank value, proceeding to 
the lowest bid value, which receives the lowest rank val- 
ue. Most preferably, the highest rank value is 1 with sue- 
so cessively increasing ordinal values, such as 2, 3, 4, ... 
assigned in order of successively decreasing rank. Un- 
der an alternative preferred embodiment, the bid values 
are used in combination with one or more other factors 
in determining rank value. As an example of other fac- 
35 tors, certain measures of relevance that are independ- 
ent of the bid value could be used. The correlation be- 
tween rank value and bid value is illustrated in FIG. 7, 
where each of the paid search list entries 710a through 
71 Of display the advertiser's bid value 750a through 
ao 750f for that entry. Preferabfy, if two search listings hav- 
ing the same search term also have the same bid value, 
the bid that was received earlier in time will be assigned 
the higher rank value. Unpaid listings 71 Og and 71 Oh do 
not display a bid value and are displayed following the 
45 lowest-ranked paid listing. Preferably, unpaid listings 
are displayed if there are an insufficient number of list- 
ings to fill the 40 slots in a search results page. Unpaid 
listings are generated by a search engine utilizing ob- 
jective distributed database and text searching aigo- 
so rithms known in the art. An example of such a search 
engine may be operated by Inktomi Corporation, The 
original search query entered by the remote searcher is 
used to generate unpaid listings through the convention- 
al search engine. 
55 [0105] As shown in the campaign management menu 
170 of FIG. 2, several choices are presented to the ad- 
vertiser to manage search listings. First, in the "Change 
Bids" selection, the advertiser may change the bid of 
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search listings currently in the account. The process in- 
voked by the system for the change bids function is 
shown in FIG. 8. After the advertiser indicates the intent 
to change bids by selecting the "Change Bids" menu op- 
tion, the system searches the user's account in the da- s 
tabase and displays the search listings for the entire ac- 
count or a default subaccount in the advertiser's ac- 
count, as shown in step 810. Search listings may be 
grouped into subaccounts defined by the advertiser and 
may comprise one or more search listings. Only one su- to 
baccount may be displayed at a time. The display should 
also preferably permit the advertiser to change the su- 
baccount selected, as shown in step 815. The screen 
display will then show the search listings for the selected 
subaccount, as indicated in step 820. is 
[01 06] An example of screen display shown to the ad- 
vertiser in step 810 is shown in FIG. 9 and will be dis- 
cussed below. To change bids, the advertiser user may 
specify new bids for search terms for which the adver- 
tiser already has an existing bid by entering one or more 20 
new bid element amounts into the new bid input field for 
the search term. The advertiser-entered bid changes 
are displayed to the advertiser at step 820 of FIG. 8 as 
discussed above. To update the bids for the display 
page, the advertiser requests, at step 830 of FIG. 8, to 25 
update the result of changes. The advertiser may trans- 
mit such a request to the account management server 
by a variety of means, including clicking on a button 
graphic. 

[0107] As shown in step 840 of FIG. 8, upon receiving 30 
the request to update the advertiser's bids, the system 
calculates the new current bid values for every search 
listing displayed, the rank values, and the bid value 
needed to become the highest ranked search listing 
matching the search term field. Preferably, the system 35 
then presents a display of changes at step 850. After 
the user confirms the changes, the system updates the 
persistent state by writing the changes to the account in 
the database. 

[0108] The search listing data is displayed in tabular *o 
format, with each search listing corresponding to one 
row of the table 900. The search term 902 is displayed 
In the leftmost column, followed by the current bid value 
904, and the current rank 906 of the search listing. The 
current rank is followed by a column entitled "Bid to be- as 
come #1" 907, defined as the bid value needed to be- 
come the highest ranked search listing for the displayed 
search term. The rightmost column of each row com- 
prises a new bid input field 908 which is set initially to 
the current bid element amounts. so 
[0109] As shown in FIG. 9, the search listings may be 
displayed as "subaccounts." Each subaccount compris- 
es one search listing group, with multiple subaccounts 
residing within one advertiser account. Each subac- 
count may be displayed on a separate display page hav- ss 
ing a separate page. The advertiser should preferably 
be able to change the subaccount being displayed by 
manipulating a pull-down menu 910 on the display 



shown in FIG. 9. In addition, search listing groups that 
cannot be displayed completely in one page may be 
separated into pages which may be individually viewed 
by manipulating pull-down menu 920. Again, the adver- 
tiser should preferably be able to change the page dis- 
played by clicking directly on a pull-down menu 920 lo- 
cated on the display page of FIG. 9. The advertiser may 
specify a new bid for a displayed search listing by en- 
tering a new bid element amounts into the new bid input 
field 908 for the search listing. To update the result of 
the advertiser-entered changes, the advertiser clicks on 
button graphic 912 to transmit an update request to the 
account management server, which updates the bids as 
described above. 

[0110] Many of the other selections listed in the "Ac- 
count Management" menu 1 70 of FIG. 2 function as var- 
iants of the "Change Bid" function described above. For 
example, if the advertiser selects the "Change Rank Po- 
sition" option, the advertiser may be presented with a 
display similar to the display of FIG. 9 used in the 
"Change Bid" function. However in the "Change Rank 
Position" option, the "New Bid" field would be replaced 
by a "New Rank" field, in which the advertiser enters the 
new desired rank position for a search term. After the 
advertiser requests that the ranks be updated, the sys- 
tem then calculates a new bid value by any of a variety 
of algorithms easily available to one skilled in the art. 
For example, the system may invoke a routine to locate 
the search listing in the search database having the de- 
sired rank/search term combination, retrieve the asso- 
ciated bid value of said combination, and then calculate 
a bid amount that is N cents higher; where N=^1 , for ex- 
ample. After the system calculates the new bid value 
and presents a read-only confirmation display to the ad- 
vertiser the system updates the bid values and rank val- 
ues upon receiving approval from the advertiser. 
[0111] In a second embodiment, there are multiple bid 
element amounts corresponding, preferably, to an im- 
pression event, a click-through event, and one or more 
action events. In this embodiment, the bid value is cal- 
culated as the sum of the values of each of the bid ele- 
ments. In this case, the "Change Rank Position" option 
would work as above for the ultimate value of the bid. In 
addition, the system would calculate and suggest indi- 
vidual bid amount elements that would result in the nec- 
essary suggested bid value. 

[0112] The "Modify Listing Component" selection on 
Account Management menu 1 70 of FIG 2 may also gen- 
erate a display similar to the format of FIG. 9. When the 
advertiser selects the "Modify Listing Component" op- 
tion, the advertiser may input changes to the URL, title, 
or description of a search listing via web-based forms 
set up for each search listing. Similar to the process dis- 
cussed above, the forms for the URL, fflte, and descrip- 
tion fields may initially contain the old URL, title and de- 
scription as default values. After the advertiser enters 
the desired changes, the advertiser may transmit a re- 
quest to the system to update the changes. The system 
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then displays a read-only confirmation screen, and then 
writes the changes to the persistent state in the user 
account database after the advertiser approves the 
changes. 

[0113] A process similar to those discussed above 
may be implemented for changing any other peripheral 
options related to a search listing; for example, changing 
the matching options related to a bidded search term. 
Any recalculations of bids or ranks required by the 
changes may also be determined in a manner similar to 
the processes discussed above. 
[0114] In the "Delete Bidded Search Term" option, the 
system retrieves all of the search listings in the account 
of the advertiser and displays the search listings in an 
organization and a format similar to the display of FIG. 
9. Each search listing entry may include, instead of the 
new bid field, a check box for the advertiser to click on. 
The advertiser would then click to piaco a check (X) 
mark next to each search term to be deleted : although 
any other means known in the art for selecting one or 
more items from a list on a web page may be used. After 
the advertiser selects all the search listings to be deleted 
and requests that the system update the changes, the 
system preferably presents a read-only confirmation of 
the requested changes, and updates the advertiser's ac- 
count only after the advertiser approves the changes. 
The "deleted" search listings are removed from the 
search database 36 and will not appear in subsequent 
searches. However, the search listing will remain as part 
of the advertiser's account record for billing and account 
activity monitoring purposes. 

[0115] In the "Add Bidded Search Term" option, the 
system provides the advertiser with a display having a 
number of entry fields corresponding to the elements of 
a search listing. The advertiser then enters into each 
field information corresponding to the respective search 
listing element, including the search term, the web site 
URL, the web site title, the web site description, and the 
bid element amounts, as well as any other relevant in- 
formation. After the advertiser has completed entering 
the data and has indicated thus to the system, the sys- 
tem returns a read-only confirmation screen to the ad- 
vertiser. The system then creates a new search listing 
instance and writes it into the account database and the 
search database upon receiving approval from the ad- 
vertiser. 

[0116] Preferably, the "Account Management" menu 
170 of FIG. 2 provides a selection for the advertiser to 
"Get Suggestions On Bidded Search Term". In this case, 
the advertiser enters a bidded search term into a form- 
driven query box displayed to the advertiser. The system 
reads the search term entered by the advertiser and 
generates a list of additional related search terms to as- 
sist the advertiser in locating search terms relevant to 
the content of the advertiser's web site. Preferably, the 
additional search terms are generated using methods 
such as a string matching algorithm applied to a data- 
base of bidded search terms and/or a thesaurus data- 



base implemented in software. The advertiser may se- 
lect search terms to bid on from the list generated by the 
system. In that case, the system displays to the adver- 
tisers the entry fields described above for the "Add Bid- 

5 ded Search Term" selection, with a form for entering a 
search listing for each search term selected. Preferably, 
the selected search term is inserted as a default value 
into the form for each search listing. Default values for 
the other search listing components may also be insert- 

10 ed into the forms if desired. 

[0117] The "Account Management" menu 1 70 of FIG. 
2 also preferably provides advertisers with a "Project 
Expenses" selection. In this selection, the advertiser 
specifies a search listing or subaccount for which the 

« advertiser would like to predict a "daily run rate" and 
"days remaining to expiration." The system calculates 
the projections based on a cost projection algorithm, 
and displays the predictions to the advertiser on a read- 
only screen. The predictions may be calculated using a 

20 number of different algorithms known in the art. Howev- 
er, since the cost of a search listing is calculated by mul- 
tiplying the bid amount by the total number of clicks re- 
ceived by the search listing at that bid amount during a 
specified time period, every cost projection algorithm 

25 must generally determine an estimated number of clicks 
per month or other specified time period for a search 
listing. The clicks on a search listing may be tracked via 
implementation of a software counting mechanism as is 
well known in the art. Clicks for all search listings may 

30 be tracked over time , this data may be used to generate 
estimated numbers of clicks per month overall, and for 
individual search terms. For a particular search term, an 
estimated number of searches per day is determined 
and is multiplied by the cost of a click. This product is 

35 then multiplied by a ratio of the average number of clicks 
over the average number of impressions for the rank of 
the search listing in question to obtain a daily run rate. 
The current balance may be divided by the daily run rate 
to obtain a projected number of days to exhaustion or 

40 "expiration" of account funds. 

[0118] One embodiment bases the cost projection al- 
gorithm on a simple predictor model that assumes that 
every search term performs in a similar fashion. This 
model assumes that the rank of the advertiser's search 

^5 listing will remain constant and not fluctuate throughout 
the month. This algorithm has the advantages of being 
simple to implement and fast to calculate. The predictor 
model is based on the fact that the click through rate. e. 
g. the total number of clicks, or referrals, for a particular 

50 searcher listing, is considered to be a function of the 
rank of the search listing. The model therefore assumes 
that the usage curve of each search term, that is, the 
curve that result when the number of clicks on a search 
listing is plotted against the rank of the search listing, is 

55 similar to the usage curve for ail search terms. Thus, 
known values extrapolated over time for the sum of ail 
clicks for all search terms, the sum of all clicks at a given 
rank for all search terms, and the sum of all clicks for 
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the selected search term may be employed in a simple 
proportion to determine the total of all clicks for the given 
rank for the selected search term. The estimated daily 
total of all clicks for the selected search term at the se- 
lected rank is then multiplied by the advertiser's current s 
bid amount for the search term at that rank to determine 
a daily expense projection. In addition, if particular 
search terms or classes of search terms are known to 
differ markedly from the general pattern, correction val- 
ues specific to the search term, advertiser, or other pa- 10 
rameter may be introduced to fine-tune the projected 
cost estimate. 

[01 19] Finally, the "Account Management" menu 1 70 
of FIG . 2 provides several selections to view information 
related to the advertiser's campaigns. The "View Sub- *5 
account Information" selection displays read-only infor- 
mation related to the selected subaccount. The "View 
Search Term List" selection displays the list of the ad- 
vertiser's selected search terms along with the corre- 
sponding URLs, bid value, and rank, with the search 20 
terms preferably grouped by subaccount The advertis- 
er may also view current top bids for a set of search 
terms selected from a list of search terms from a read- 
only display generated by the system upon receiving the 
requested search terms from the advertiser. 25 
[0120] For an advertiser who requires a more com- 
prehensive report of search listing activity, the "View Re- 
port" option may be selected from the Advertiser Main 
Page 120 of FIG. 2. In an embodiment, the "View Re- 
port" options generate reports comprehensive for up to 30 
one year preceding the current date. For example, daily 
reports are available for the each of the immediately pre- 
ceding 7 days, weekly reports for the preceding four 
weeks, monthly reports for the preceding twelve 
months, and quarterly reports for the last four quarters. 35 
Additional reports may also be made available depend- 
ing on advertiser interest. Other predefined report types 
may include activity tracked during the followingtime pe- 
riods: Since Inception of the Account, Year To Date, 
Yearly, Quarter To Date, Month To Date, and Week to 40 
Date. Report Categories may include a Detail Report, 
viewable by Advertiser Account, by Search Listing, and 
by URL, and a Summary Report, viewable by Advertiser 
Account and by Subaccount The reports may include 
identification data such as advertiser account and sub- 45 
account name : the dates covered by the report and the 
type of report. In addition, the reports may include key 
search listing account data such as current balance, 
pending current balance, average daily account debit, 
and run rate. Furthermore, the reports may also include so 
key data, such as; search terms, URLs, bids, current 
ranks, and number of clicks, number of searches done 
forthe search term, number of impressions, which is the 
number of times that the search listing appeared in a 
search result list, click through rate wh ich in one embod- 55 
rment is the Number of Clicks divided by the Number of 
Impressions, and one or more action rates, which is de- 
fined as Number of Actions divided by the Number of 



Impressions. Preferably, the report is available in at 
least HTML view options for viewing via a browser pro- 
gram, printing, or downloading. Note, however, that oth- 
er view options may be made available, such as Adobe 
Acrobat, PostScript, ASCII text, spreadsheet inter- 
change formats (e.g., CSV, tab-delimited), and other 
well-known formats. 

[0121] When the advertiser has selected the "View 
Report" option, the system invokes a function which dis- 
plays a list of available report types, dates, categories, 
and view options. The system preferably creates a re- 
port instance with the following fields, all of which are 
initially set to null: report type, report date, report cate- 
gory, and view option. Once the advertiser has defined 
the parameters described above, the system invokes a 
function to generate the requested report, based on the 
advertiser-set parameters, and to display the report, 
based on the view option parameter. 
[0122] Finally, one embodiment implements an option 
for context specific help that the advertiser may request 
at any time the advertiser is logged in. The help option 
may be implemented as a small icon or button located 
on the system generated display page. The advertiser 
may click on the icon or button graphic on the display 
page to request help, upon which the system generates 
and displays a help page keyed to the function of the 
particular display the user is viewing. The help may be 
implemented as separate display pages, a searchable 
index, dialog boxes, or by any other methods well known 
in the art, 

[0123] The foregoing detailed description should be 
regarded as illustrative rather than limiting and the ap- 
pended claims, including all equivalents, are intended 
to define the scope of the invention. 



Claims 

1. A method of generating a search result list in re- 
sponse to a search request from a searcher the 
method comprising: 

storing a plurality of search listings (344), each 
search listing being associated with a bid 
amount (358) and a search term (352), the bid 
amount including a market value correspond- 
ing to a money amount chargeable to an ac- 
count of an advertiser associated with the 
search listing; 

determining the market values of the respective 
bids amounts by determining a product of a bid 
received from a respective advertiser and a 
probability that one or more bid events will oc- 
cur, the one or more bid events including a 
click-through, including 

calculating a numerator as a ratio of an es- 
timated number of times the one or more 
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bid events will occur to an estimated 
numberof times the one or more bid events 
could occur within a specified time period, 

calculating a denominator representing the 5 
standard click-through rate for listings of 
the average ranking, over the same spec- 
ified period of time, of the identified search 
listing corresponding to the bid, and 

10 

calculating the probability as the ratio of the 
numerator to the denominator; 

receiving a search request from the searcher; 
identifying search listings having search terms 
generating a match with the received search re- 
quest; 

ordering the identified search listings in a 
search result list according to values of the re- 
spective bid amounts of the identified search 20 
listings; 

detecting a ciickthrough by the searcher of one 
of the ordered search listings; and 
in response to the ciickthrough, charging the 
account of the advertiser associated with the 25 
one search listing by the bid amount. 

A method of operating a pay for placement web site, 
the method comprising: 

30 

maintaining a database (38) searchable by a 
search engine (24), the database including a 
plurality of search listings (344), each search 
listing being associated with an Internet web- 
site, a search term (352) and a bid amount 35 
(358), the bid amount corresponding to a mon- 
ey amount chargeable to a web site promoter 
each time the web site promoter's web site is 
referred by the search engine; 
receiving a search request from a searcher; *o 
identifying search listings generating a match 
with the search request; and 
ordering the identified search listings into a 
search result list in accordance with the values 
of the respective bid amounts for the identified *5 
search listings; 

receiving none, one or more of the following: 

a retrieval request from the searcher to re- 
trieve information associated with a select- 50 
ed search listing in the search result list, 
and 

one or more notifications that the searcher 
has performed one or more respective ac- 
tions in connection with the selected ss 
search listing; 

debiting the account of the web site promoter 



associated with the selected search listing and 
the respective bid amounts as follows: 

by the bid element amount for impression, 
by the bid element amount for ciickthrough, 
provided a ciickthrough request was re- 
ceived, and 

by the bid element amounts for, respective- 
ly, one or more actions, provided notifica- 
tions were received for said one or more 
actions. 

3. The method of claim 2 wherein the values of the 
respective bid amounts are calculated as the sum 
of: 

the bid element amount for impression; 
the value of the bid element amount for ciick- 
through; and 

the respective values of the bid element 
amounts for actions. 

4. The method of claim 3 wherein the value of the bid 
element amount for ciickthrough is calculated as a 
product of the bid element amount and the proba- 
bility that the ciickthrough event will occur. 

5. The method of claim 4 wherein the probability is cal- 
culated as a ratio of an estimated number of times 
the ciickthrough events wilt occur to an estimated 
number of times the ciickthrough events could oc- 
cur within a specified time period. 

6. The method of claim 4 further comprising: 

calculating a numerator as a ratio of an estimat- 
ed number of times the ciickthrough events will 
occur to an estimated number of times the click- 
through events could occur within a specified 
time period; 

calculating a denominator representing the 
standard click-through rate for listings of the av- 
erage ranking, over the same specified period 
of time, of the identified search listing corre- 
sponding to the bid; and 

calculating the probability as the ratio of the nu- 
merator to the denominator. 

7. The method of claim 3 wherein the value of a bid 
element amount for an action is calculated as the 
product of the bid element amount and the proba- 
bility that the action event will occur. 

8. The method of claim 7 wherein the probability is cal- 
culated as a ratio of an estimated number of times 
the action events will occur to an estimated number 
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of times the action events could occur within a spec- 
ified time period. 

9. The method of claim 7 further comprising: 

calculating a numerator as a ratio of an estimat- 
ed number of times the action events will occur 
to an estimated number of times the action 
events could occur within a specified time pe- 
riod; 

calculating a denominator representing the 
standard click-through rate for listings of the av- 
erage ranking, over the same specified period 
of time, of the identified search listing corre- 
sponding to the bid; and 

calculating the probability as the ratio of the nu- 
merator to the denominator. 

10. A method of generating a search result list in re- 
sponse to a search request from a searcher, the 
method comprising: 

storing a plurality of search listings (344), each 
search listing being associated with an Internet 
website, one or more search terms (352) and 
one or more bid elements (358), each bid ele- 
ment amount corresponding to a money 
amount chargeable to a web site promoter each 
time the web site promoter's web site is referred 
by a search engine (24); 
receiving a search request from a searcher; 
identifying search listings generating a match 
with the search request; and 
ordering the identified search listings into a 
search result list the order of which is influ- 
enced by the values of the respective bid 
amounts for the identified search listings; 
receiving none, one or more of the following: 

a retrieval request from the searcher to re- 
trieve information associated with a select- 
ed search listing in the search result list, 
and 

one or more notifications that the searcher 
has performed one or more respective ac- 
tions in connection with the selected 
search listing; debiting the account of the 
web site promoter associated with the se- 
lected 

search listing and the respective bid ele- 
ments as follows: 

by the bid element amount for impres- 
sion, provided the system allows lor 
bidding by impression, 
by the bid element amount for click- 
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through, provided the system allows 
forbidding by clickthrough, and provid- 
ed a clickthrough request was re- 
ceived, and 

by the bid element amounts for, re- 
spectively, one or more actions, pro- 
vided the system allows for bidding by 
action, and provided notifications were 
received for said one or more actions. 

11. The method of claim 10 wherein the values of the 
respective bid amounts are calculated as the sum 
of: 

the value of the bid element amount for impres- 
sion, provided the system allows forbidding by 
impression; 

the value of the bid element amount for click- 
through, provided the system allows forbidding 
by clickthrough; and 
the respective values of the bid element 
amounts for actions, provided the system al- 
lows for bidding by action. 

25 12. The method of claim 11 whereinthe value of the bid 
element amount for impression is calculated as the 
ratio of the bid element amount and the intrinsic 
CTR applicable to a particular ranking for the search 
term to which the current listing applies, the partic- 
ular ranking having been selected by the system. 
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13. The method of claim 11 wherein the value of the bid 
element amount for clickthrough is calculated as a 
product of the bid element amount and the proba- 

3S bility that the clickthrough event will occur, 

14. The method of claim 13 wherein the probability is 
calculated as the clickthrough rate for the current 
listing. 

40 

15. The method of claim 13 wherein the probability is 
calculated as the ratio of the clickthrough rate for 
the current listing, and the average intrinsic click- 
through rate applicable to the various rankings held 

4 & by that listing. 



16. The method of claim 11 wherein the value of a bid 
element amount for an action is calculated as the 
product of the bid element amount and the proba- 
bility that the action event will occur. 

17. The method of claim 16 wherein the probability is 
calculated as the action rate for the current listing. 

18. The method of claim 16 wherein the probability is 
calculated as the ratio of the action rate for the cur- 
rent listing, and the average intrinsic clickthrough 
rate applicable to the various rankings held by that 
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listing. 

19. A method of generating a search result list in re- 
sponse to a search request from a searcher, the 
method comprising: 5 

storing a plurality of search listings (344) . each 
search listing being associated with a bid 
amount (358) and a search term (352), the bid 
amount including a market value correspond* 1 o 
ing to a money amount chargeable to an ac- 
count of an advertiser associated with the 
search listing; 

determining the market values of the respective 
bids by calculating the product of a bid received is 
from a respective advertiser a clickthrough rate ■ 
associated with the listing corresponding to that 
bid, and 

a number representing the rank-inde- 
pendent comparative attractiveness of the list- 20 
ing corresponding to that bid; 
receiving a search request from the searcher; 
identifying search listings having search terms 
generating a match with the received search re- 
quest; 25 
ordering the identified search listings in a 
search result list according to market values of 
the respective bids; 

detecting a clickthrough by the searcher of one 
of the ordered search listings; and 30 
in response to the clickthrough, charging the 
account of the advertiser associated with the 
one search listing by the bid amount. 

20. The method of claim 1 9 wherein the number repre- 35 
senting the rank-independent comparative attrac- 
tiveness of the listing corresponding to the bid is as- 
sociated with relevance of the listing. 

21. The method of claim 20 wherein the relevance of *o 
the listing is associated with one or more of the sub- 
ject matter of the listing, the brand recognition of the 
advertiser, and the geographic location of the ad- 
vertiser. 

45 
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